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FIXED-BASE- SIMULATOR EVALUATION OF A PILOT'S 

TERRAIN-FOLLOWING DISPLAY WITH VARIOUS 

MODES OF PRESENTING INFORMATION 

By Thomas E . Wempe 

Ames Research Center 
Moffett Field, Calif. 

SUMMARY 


An exploratory study was made of human ability to use a visual display 
to guide a high-speed aircraft in close proximity to the terrain . The con- 
trol dynamics of a small aircraft flying near sea level at a Mach number of 
1.2 were simulated on an analog computer interconnected with a two -axis side- 
arm controller and a cathode -ray tube display. The pilot’s task was to guide 
the aircraft as closely as possible to simulated terrain while minimizing a 
heading error. No motion cues or other environmental stresses were provided. 

It was noted that the pilot's performance was markedly influenced by 
variations in the visual display of the aircraft attitude and position 
relative to the terrain. 

A l-l/2 -hour sustained terrain -following task with this fixed-base 
simulation revealed no major degradation in pilot performance . 


INTRODUCTION 

The high-speed, low-level flight is a particularly demanding mission of 
a tactical fighter during all-weather operation. This type of mission 
requires a method for controlling the flight path of the aircraft to maintain 
close proximity to the terrain when visual conditions are inadequate . Pre- 
vious studies have considered methods varying from manual control by a pilot 
viewing a radar presentation to completely automatic terrain-following 
systems . The results of many of these investigations are summarized in 
reference 1. 

A terrain -following system must provide sufficient information so that 
the pilot can either control the aircraft manually or monitor the performance 
of a completely automatic system to effect manual recovery in an emergency. 
Though a number of particular terrain -tracking displays have been tested, 
there appears to be a lack of information regarding human ability to use such 
displays for extended periods of time. Also, not much data is available 
regarding the effects of varying the information presented on these displays. 

As a part of a general NASA study of the pilot -vehicle system for 
advanced aircraft missions, a fixed-base simulator was used to study manual 
terrain-following performance as affected by the type of information dis- 
played. The vehicle simulated was an attack aircraft. The specific 


objectives of this initial study were to evolve a situational display 
suitable for general research on the terrain -following task, noting the 
effects of the display on performance . The situational display was to pro- 
vide the pilot continuously with readily interpretable information of the 
present position and attitude of the aircraft with respect to the terrain and 
with predictive information so that he can plan and execute a low ground- 
clearance flight path. It was assumed that the following information would 
be readily available as quantified data: (l) absolute height above the ter- 

rain directly below; and ( 2 ) angular measures from the horizon to the terrain 
at two fixed slant ranges. 

It is emphasized that the simulation of the terrain-following task 
discussed in this report included no motion effects on the pilot, which at 
this speed and flight level could be very severe . It is also pointed out 
that the complexities of aircraft management, that is, power control, trim, 
navigation, etc., were reduced to a simplified control of the flight path. 
Further, this investigation was limited to a fixed course task where only the 
terrain in a straight line ahead of the aircraft was considered. The investi- 
gation included an evaluation of use of a terrain -following display for rela- 
tively long time periods and a comparison of the results obtained from the 
present investigation with those of previous studies. 


SYMBOLS 


A aircraft altitude, ft 

H aircraft height above terrain, ft 

K mean of variable K; for example, A is the mean aircraft altitude 
N number of data points in sample 

r correlation coefficient 

Sj£ standard deviation of variable K; for example , Sa is the standard 
deviation of aircraft altitude 

s Laplace operator 

T terrain altitude, ft 

a angle of attack 

ccq trim angle of attack 

^a aileron deflection 

6 e elevator deflection 
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9 pitch attitude 

cp bank angle 
■ 4 c yaw angle 

w n aircraft undamped short-period natural frequency in pitch, radians/sec 
t, aircraft short -period damping ratio in pitch 

METHOD 

Equipment 


The equipment used in providing a rudimentary simulation of the problem 
was an oscilloscope for presentation of steering information, a two-axis side- 
arm controller, a chair, an analog computer plus a low-frequency function 
generator, a Gaussian noise generator and a motorized switch for computation 
of the terrain kinematics and aircraft dynamic response and an eight-channel 
strip recorder for data recovery. 


Simulation 


The aircraft dynamics simulated (appendix A) were representative of an 
attack aircraft flying near sea level at a Mach number of 1.2. Several sim- 
plifications in these dynamics were programmed on the analog computer: 

1. Variations in thrust and velocity were omitted. 

2. Only small perturbations about straight and level flight were 
considered . 

3 . Only pitch and roll transfer functions were simulated. 

k. The heading angle as presented was included in the problem only to 
increase the pilot's workload, and though it was somewhat realistic, 
it was not a true representation of this aircraft type . 

A Gaussian noise generator and analog equipment provided the altitude 
variation. Delay circuitry was employed to represent points 10 seconds ahead 
( 2 -l /2 miles), 5 seconds ahead. (l-l/% miles), and directly beneath the air- 
craft. As explained in appendix B, where the terrain generation is described 
in greater detail, two different "terrains" were used in this investigation. 
The first was somewhat rough as compared to a sample of California terrain, 
but was used throughout the display evolution phase. After a suitable dis- 
play was established, less severe terrain was used for the concluding tracking 
run . 
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The situational display was presented on a 5-inch cathode-ray tube (CRT) 
and at all times contained elements depicting the horizon reference, heading, 
and the terrain at points 0, 5, and 10 seconds ahead of the aircraft. This 
display was similar to that used in a previous study, where nine test pilots 
did terrain -following in a G-seat with different wind gust levels simulated 
(ref. 2), in that it presented the same kind of information. However, in the 
current study, several changes in the method of presentation were made during 
the study and results noted . Figure 1 is a sketch of an aircraft in the 
terra in -fo ll ow ing mode . Figure 2 presents the variations in the situational 
display, depicting the attitude and position of the aircraft (fig. l) used 
in the study. 


Te st Setup 


The subject was seated so that his line of vision was perpendicular to 
the CRT face and his eyes were approximately 19 inches from it . The pencil 
controller was placed on a stand to his right at a sufficient height so that 
he could rest his forearm flat on top of the controller while holding the 
control stick knob with his thumb, index finger, and forefinger. Figure 3 
shows the subject's position relative to the CRT and controller. 

For each terrain-following run the following data were recorded 
continuously: heading error, rate of climb, normal acceleration, bank angle, 

elevator angle, altitude above terrain, terrain height below multiplexed with 
aircraft altitude, and terrain height 10 seconds ahead. 

Figure 4 is a block diagram of the experimental configuration. 


Test Procedure 


Since this study was exploratory, the general approach was one of trial 
and revision of the situation display. First, a display with elements rela- 
tively common to experience was established and the pilot practiced following 
the terrain as closely as he could without contacting the ground until he felt 
that he was no longer improving his performance (10 to 20 minutes practice was 
usually required); then trial runs of approximately 3^ minutes were made and 
time histories recorded. At this point, the pilot's subjective views along 
with his record determined changes to the display, and then the cycle was 
repeated . Ho effort was made to adjust for the learning of the subject 
throughout the evolution of the displayed information; consequently, his 
earlier performance on the -unimproved display probably was poorer than it 
would have been if that display had been represented at the end of the test 
series. However, it was believed that the pilot's opinion and obvious dis- 
crete jumps in performance would obviate, at least for this exploratory study, 
establishing a balanced experimental plan to offset the effects of learning, 
fatigue , etc . 
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After acceptable displays for the simulated task were established, 
several terrain-following runs were made . Pen records of these runs were 
analyzed to obtain performance data. 

The subject was the experimenter: 1 male; 37 years old; moderate 
experience as controller of flight simulators; approximately 2000 flying 
hours in light aircraft, rated as commercial pilot. Single Engine Land 
(S.E.L.) flight instructor. 


The following table summarizes the data that were analyzed. 



Display 

Task 

Terrain simulation 

Designation 

Figure 

Description 

duration, 

min 

C 

2(c) 

Terrain ahead displayed as 
angular measures, 6° /cm on 
CRT 

15 

High frequency 
terrain . Peaks to 
about 2500 feet . 

D 

2(d) 

Terrain ahead displayed as 
relative height, 333 ft/cm, 
with altimeter 

90 

I! 

E 

2(e) 

Terrain displayed as rela- 
tive height, 333 ft/cm, 
maximum of T 10 added 

6 

rr 

F 

2(f) 

Display same as E except 
pitch angle scaled 2.2°/cm 
and heights scaled 250 
f t /cm . 

15 

Low frequency 
terrain . Peaks to 
about 2500 feet . 


RESULTS AND DISCUSSION 

Effects of Display Mode on Terrain -Following Performance 


Several display modes, conceptually similar but different in detail 
(figs. 2(a) through 2(e)), were evaluated. Appendix C describes in some 
detail the evolution of the various display modes evaluated and some qualita- 
tive impressions of the pilot with regard to the suitability of the displays 
for the terrain-following task . 

In the present section, a summary of terrain-following performance for 
several selected display modes is provided in the following table . (A dis- 
cussion of the statistics used to evaluate terrain-following performance is 
given in appendix D; however, a brief description is repeated here.) In the 

1 Terrain-following performance evaluation in a subsequent study indicated 
that the performance levels of two Ames test pilots and of the subject of the 
present study were roughly equivalent . 
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table, r Is the correlation coefficient between the terrain altitude T and 
the aircraft altitude A; Sj\_ and Sp are the respective sample standard devia^ 
tions; H and 'Sjj are the sample mean and sample standard deviation of the 
aircraft height above the terrain, that is, H = A - T; N is the number of 
independent sample points used to determine the above statistics. 


Display 

Description 

N 

Sampling 
rate,* sec 

r 

S a /St, 

ft 

H, 

ft 

ft 

C 

Terrain ahead displayed 
as angular measures, 
6 °/cm on CRT 

80 

10 

0.71 

kll 

3 il = X -35 

505 

292 

D 

Terrain ahead displayed 
as relative height, 

333 ft/cm, with 
altimeter 

k8k 

10 

.90 

= 1.52 

276 

560 

207 

E 

Terrain displayed as 
relative height, 333 
ft/cm, maximum of T 10 
added 

36 

10 

. 9 ^ 

500 

386 - ^ 

38 ^ 

193 


*The determination of sampling rate is explained in appendix B. 


The improvement in performance as the display was evolved is quite 
evident in the data of this table. The correlation coefficient, r, a measure 
of the pilot’s ability to place the flight path of the aircraft in phase with 
the terrain, shows a consistent increase to 0 . 9 ^-, the value obtained for 
display E. The ratio of Sa to Sp approaches 1 (from the '‘overcontrol" 
side) as the correlation coefficient approaches 1. Both the mean height 
above the terrain, H, and the standard deviation of height, Sg, show consis- 
tently decreasing values as improvements were made to the display. 

Figures 6 , and 7 are histograms of aircraft height above the terrain 
and graphically show this improvement in performance as the display was 
improved . 

Terrain-following was also done with what was considered to be an 
improved version" of display E, namely, display F; however, the terrain simu- 
lated was changed at this point in the study and, hence, the results were not 
directly comparable. This final display is described in appendix C. 


Terrain-Following for an Extended Period of Time 


The data obtained from the 90 _ niinute terrain-following run using 
display D and an altimeter were analyzed by 10 -minute periods and are pre- 
sented below. Note that the first 10 minutes of this task were allowed for 
practice and were not analyzed. 
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10 -minute 
time period 

N 

r 

Sa/St, 

ft 

H, 

ft 

ft 

1 

6l 

O.93 

4 28 = 1.60 
268 

527 

205 

2 

6i 

.81 

323 = !. 71 
189 

589 

202 

3 

6i 

•90 

^58 = 

311 

589 

222 

4 

57* 

.94 

= 1.56 
338 

601 

241 

5 

6i 

.92 

2H = 1 .4i 
264 

526 

166 

6 

6i 

•95 

221 - i .46 
228 

508 

13^ 

7 

6i 

.88 

^ 38 - 1.46 
301 

613 

222 

8 

6i 

.89 

ha „ !. 5 6 

2 69 

530 

217~ 

Total 

484 

.90 

421 

560 

207 


*Four samples occurred during a reset to correct for 
computer drift and were removed. 


It appeared that there was a period of adjustment and settling down at 
the beginning of this run (time periods 1 and 2) followed by a period of 
sustained performance showing a slight improvement toward the end (time 
periods 3 to 6) and ending with a slight reduction in performance (time 
periods 7 and 8) . In the last two minutes of this run, there was a near miss 
of approximately 40 feet, followed by slightly erratic performance; however, 
this was due to the subject -operator 1 s looking away from the display to view 
a watch. In spite of these noticeable differences in performance, it can be 
concluded that no significant changes in performance were evident over the 
80-minute portion of this l-l/2-hour tracking run. 

As the task extended through time , the subject experienced several brief 
periods when the signals on the CRT appeared confused (i.e., blurred together 
and lacking meaning); however, his recovery was rapid enough not to affect 
his performance noticeably. This blurring may have been aggravated by the 
intensity or flickering of the CRT; however, it was not investigated further. 
It was evident during these simulated terrain-following tasks that the subject 
could be allowed very little time for diverting his eyes away from the display 
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sc annin g pattern without a subsequent effect on his performance . As mentioned 
above , the mere requirement of reading a wrist watch could have a marked 
effect on terrain-following performance . 

A general feeling of tenseness was experienced throughout the run, 
followed by a mild feeling of fatigue after culmination of the task . 

Though normal acceleration (at the center of gravity of the simulated 
vehicle) was recorded, it was doubtful that this measure had too much meaning 
in these tests; that is, had there been motion feedback, the over-all acceler- 
ation might have been reduced by the pilot's reluctance to impose sizable 
loads upon himself, or increased by coupling between the pilot, control sys- 
tem, and aircraft dynamics. It was noted that the maximum accelerations 
decreased from -2-3 and +6. Og for display C to -2.0 and +4-7g for display E, 
which corresponded more closely to results from actual terrain -following 
flights as reported in reference 3- A more detailed comparison with the data 
of this reference is made in the next section. 


Comparison With Other Terrain-Following Data 


In order to provide some information on the correspondence of the 
results of the present study with results of other terrain-following investi- 
gations, the following table was prepared. Selected portions of the flight 
data of reference 3 and. the moving-cockpit data of reference 4 were 
extracted and analyzed. The results for display F (see appendix C) were used 
for comparison with previous data since the terrain characteristics used with 
this display corresponded closely to the actual terrain flown over in the 
flight study . 


Task 

Description of 
terrain-following task 

N 

Sampling 

rate* 

r 

Sa/St, 

ft 

H, 

ft 

S H> 

ft 

1 

Visual in a Hunter 6 (single seat 
fighter) over hilly desert at Mach num- 
ber 0 .88 with minimum effort . Gust 
effects were marked to unpleasant . Max- 
ima acceleration, 0 and +l-7g. 

36 

. 

one per 
10 sec 

0.83 

g ■ °- 77 

608 

261 

2 

Same as 1 above but at Mach number 0.7 
with maximum effort . Gust effects were 
marked to unpleasant . Maxima of accel- 
eration, -0.6 and +2.4g. 

36 

one per 
10 sec 

.966 

g ■ !■« 

306 

142 

3 

Instrumented in a G-seat simulator using 
a compensatory height tracking display 
and other instruments at Mach number 0.9- 
Short -period longitudinal dynamics were: 

= 6-3 radians/sec , £ = 0.4; gusts at 
6 ft/sec rms . 

17 

one per 
10 sec 

.987 

^ = p.07 
121 

202 

22 

— 

Current study using display F and low- 
frequency terrain. Velocity simulated: 
Mach number 1.2. Short -period longi- 
tudinal dynamics: ton = 6.6 radians/sec, 

£ = 0-3; no gusts. Maxima of accelera- 
tion, -0 -5 and +3 .0g (neglecting sharp 
spikes) . 

30 

one per 
30 sec 

.94 

= 1.09 
351 

296 

131 


*The sampling rate for tasks 1-3 was arbitrary since the terrains were not analyzed for 
autocorre lat ion . 
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The data for tasks 1 and 2 were obtained from reference 3 • The 
improvement in performance from task 1 to task 2 is very apparent in this 
table . That the pilot of task 1 was smoothing or filtering the terrain is 
suggested by the lower value of r coupled with the ratio of SpJ Srj being 
less than 1. The data for task 2 give considerable support to the description 
"maximum effort." The value of r approaches 1, the ratio of SpJ S'? 
approaches 1, and H is low relative to the type of terrain. 

When the data of task 2 were compared with that of the current_study for 
display F, similarities were noted in the values of Sa/s>j>, r, and H, though 
slightly better terrain-following was evident in the performance of task 2. 
That the value of Sjj for task 2 was slightly higher was attributed to the 
higher amplitude of the terrain for that task (as explained in appendix D, 
the values Sg and Sp are related) . A histogram of height above the terrain 
performance for display F is presented in figure 8- A similar figure for 
task 2 is presented in figure 9- It was noted also that the acceleration 
limits encountered in task 2, -0.6 to +2.4g, were somewhat similar to those 
simulated for performance with display F, -0-5 to +3-0g. 

Task 3 in "the above table, sampled from reference 4 (fig- B-l) , 
approaches perfect terrain-following at a fixed clearance height . That this 
performance level was possible, considering that the pilot did not have infor- 
mation of the terrain ahead (control was achieved primarily by use of an 
altitude error display and a subsidiary instantaneous rate-of -climb instru- 
ment), is attributed primarily to the subdued terrain represented 
(St = 121 ft). This example is mentioned to emphasize that pilot -vehicle 
terrain-following performance can legitimately be compared only when the 
"terrains" involved are relatively similar in configuration. 

In conclusion, if the considerable differences in environment are 
neglected, the similarity of the "terrains" (see figs. 10(a) and 10(b) and 
the discussion in appendix B) and performance of task 2 and the current study 
suggest that display F provided much of the information obtained from a 
straight-ahead view through the windshield of a low-flying aircraft. 


CONCLUDING REMARKS 


From results of a fixed-base simulation of a low-level, high-speed 
terrain-following task, the following observations were made : 

Comparative terrain -following performance measures for several display 
modes showed that performance improved progressively as: 

1. The terrain points ahead were displayed as heights relative to 
the aircraft, rather than as angles relative to the horizon, 

2. The pitch angle was magnified, compared to the scaling for 
standard attitude instruments for aircraft. 



3- An indicator was added, providing continuous information on 
maximum heights of the terrain ahead (i.e., maxima of terrain 10 sec ahead) . 

The results of sustained simulated terrain following with a visual 
display for 1-1/2 hours indicated that no significant degradation in perform- 
ance had occurred, though the subject was mildly fatigued. 

The close correspondence between the terrain-following results of the 
present study and those of a previous flight study (for roughly similar ter- 
rains) suggests that the display used provided much of the information pro- 
vided by a straight-ahead view through the windshield of a low-flying 
airplane . 


Ames Research Center 

National Aeronautics and Space Administration 
Moffett Field, Calif., June 15, 1964 


10 



APPENDIX A 


SIMULATION 
Aircraft Dynamics 


The following transfer functions were programmed on an analog computer 
to simulate the dynamics of an aircraft flying near sea level at a Mach num- 
ber of 1 . 2 . 


Longitudinal : 

Q_ 

^e 

• « 

_A_ 

&e 

A 


-50-3(S + 1.07) 

S(s 2 + 3.61 S + 44.2) ’ 

-23,844(3 - 2-9) 

S(S 2 + 3.61 S + 44.2) 

1 A ft 

S 2 S e ’ radian 


Lateral directional: 


(sideslip assumed zero) 


radian / radian 

ft/ sec 2 
radian 


9 

-118 

radian 

5 a 

S(S + 3-79) ' 

radian 

V 

_ K 9 radian 


&a 

S b a radian 



K was arbitrarily adjusted to give a t|t of l/40 cm/ sec per degree of cp on 
the CRT. 


Control Characteristics 

The side-arm pencil controller forces were: 

Elevator : 

O.O 67 lb/deg of elevator maximum travel, 0.8 in. at 1 lb 
Aileron : 

0 .l 6 lb/deg of aileron maximum travel, 1.3 in. at 1.6 lb 
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APPENDIX B 


DESCRIPTION OF TERRAIN GENERATED 


An examination of cross-sectional cuts through, terrain suggested that a 
reasonable approximation of a section of terrain could be accomplished by 
summing a long- and a short -period wave, where the long -period wave was 
sinusoidal to represent gradual changes in terrain elevation and the short- 
period wave was peaked to represent hilltops and valleys . For the purpose 
of this study the long-period terrain waves were ignored since they appeared 
to have a relatively gradual rate of ascent and descent and would probably 
introduce only minor problems in terrain-following. The short -period waves, 
however, would obviously introduce considerable difficulty in low-level 
terrain -following, and, hence, were used here to simulate this portion of 
terrain characteristics. 

It was empirically determined that a reasonably good approximation to 
the terrain short -period waves could be obtained by squaring filtered Gaussian 
noise . The filter used for the bulk of this study was second order with a 
damping ratio of 0.7 and a natural frequency of 0.2 radian/ second (0.13 
cycles/ mi le) . The amplitude was adjusted so as to generate peaks of about 
1000 feet, with occasional tops above 2000 feet. This produced "terrain" 
which, as viewed from the aircraft at a Mach number of 1.2, sometimes varied 
up to 300 ft/sec. Figure ll(a) presents a typical histogram of terrain rates. 
Figure ll(b) is a sample of the terrain cross section as generated. 

A somewhat similar scheme for terrain generation was employed with a 
reasonable match to real terrain by the Cornell Aeronautical Laboratory in 
reference 5 . In this more complicated scheme the filtering and squaring was 
done digitally with random numbers and included a long-period effect . The 
appearance of the terrain generated for that study, however, was not markedly 
different from the appearance of the terrain resulting from the rather simple 
scheme used in this report . 

Prior to the last tracking run of this study the terrain as generated 
was compared with a cross section of hilly California terrain, Oakland to 
avenal via V 107, and it was decided that though the amplitude of the gener- 
ated terrain reasonably approximated the amplitude of the high-frequency 
content of the California terrain, the occurrence of "hills" in the generated 
terrain was too frequent . Subsequently, the natural frequency of the filter 
was reduced to O.O67 radian/second ( 0.0^3 cycle /mile) as a better approxi- 
mation. Figure 12 shows a sample of each of these "terrains." 

In the course of this investigation the terrain-following performance 
with display F (terrain filter set at 1% = O.O67 radian/second) was compared 
to a sample of terrain-following performance extracted from reference 3> in 
which the terrain was actual hilly African desert. In comparing these two 
"terrains" it was noted that the African desert had a more plateau-like 
character with each hill rising to approximately 1500 feet, while the height 
of the hills of the current study exhibited more variability but a lower 
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average. Also, the occurrence of hills in the sample of African desert was 
more frequent than in the current study; however, when the two terrains were 
portrayed on the same time scale as they would appear when viewed from the 
aircraft, this difference was not so apparent (figs. 10(a) and 10(b)). 

It was believed that the major difference between these two terrains as 
viewed from the aircraft would be that the African desert was rougher and 
required more control but also contained fewer surprises (e.g., the sudden 
appearance of a hill over 2000 feet preceded by a series of hills under 
700 feet . 

The terrain as generated was designated as the terrain height 10 seconds 
ahead, and then, by use of 5- and. 10-second Pade delay circuits, the terrain 
heights at points 5 seconds ahead and directly below, respectively, were 
obtained. Notice that this technique of simulating the terrain always pro- 
vided the height of the terrain ahead, even though in reality the pilot might 
not always have this information. For example, if the aircraft were quite 
close to the terrain and approaching a rather peaked hill, at some position of 
the aircraft, the terrain at fixed distances ahead might be on the far side 
of the hill and not be visible . It is reasoned that this ability to "look 
through" the hills in the simulation did not materially influence performance 
because it would occur only infrequently and would be noticeable only in the 
10-second terrain-height indicator during or slightly before pushover; at 
this time, the pilot would not be attending to this indicator other than to 
note that it was not rising. 

There was some curiosity concerning the distribution function of terrain 
amplitude as generated, since this was expected to appear to some extent in 
the distribution of height above the terrain. The output of the Gaussian 
noise generator used had the following amplitude distribution function: 


f xU) 




-00 < x < 00 


where cr was some arbitrary constant representing the standard deviation 
(also RMS in this case since the mean was zero) . 

The effect of filtering (a linear operation) would only change d, 
leaving the form of the distribution function unchanged. 


The effect of squaring the filter output, however, was to transform the 
distribution function to a function of T, where T = X 2 : 


f T (t) = f x x(t) 



x(t) = + s ft j -\Tfc 


-1/2 -t/2d 2 

, 0 < t < 00 

sj2 it a 


13 



Let 


T 

Z = — , a normalized variate 
a ^ 


Then 


f z( z ) = 


„ -1/2 -Z/2 [(l/2) - l] -z/2 

z e _ z e 


0 < z < 


s/2rt [(l/2) - 1]!2 1/2 

which is a chi-square distribution with K = 1 degree of freedom. 


This was verified by fitting a chi-square distribution to a normalized 
sample of generated terrain and subjecting the fitted distribution to a 
goodness-of -f it test. The results indicated good agreement. 


The implication of the foregoing discussion was that if the pilot of the 
current study did any smoothing of the terrain or if his height above the 
terrain was proportional to the terrain height, then the distribution function 
of height above the terrain would contain a chi-square element (when normal- 
ized by appropriate scaling) and would be skewed. This hypothesis is sub- 
stantiated by histograms of height above terrain in figures 5 to 8. 

Another consideration given to the terrain generated was the auto- 
covariance introduced by the linear filter, inasmuch as it was expected that 
independent samples of data at discrete points in time would be desired for 
analysis. As suggested in reference 6, p. 20 ff, for a linear filter the 
solution of the approximation, Aw At - 1 (where Aw is the spectral band- 
width and At is the correlation time), defines an interval outside of which 
the autocorrelation function takes comparatively small values (approximately 
l/2 or less of the autocorrelation at t = 0) . For the terrain used in the 
bulk of this investigation At « 5 seconds; for the terrain used in the con- 
cluding run At ~ 15 seconds. This implied that sampling rates of about 10 
and 30 seconds, respectively, might be used to obtain reasonably independent 
samples. This was verified by subjecting samples of the high frequency and 
the low frequency terrain to an investigation of the autocorrelation present. 
In the high frequency case (i.e., Wq = 0.2 radian/sec), the autocorrelation 
was negligible at At = 10 seconds. In the low frequency case (i.e., 

= O.O 67 ), the autocorrelation was JO percent at At = 10 seconds, 30 per- 
cent at At = 20 seconds, and 6 percent at At = 3O seconds relative to the 
autocorrelation at At = 0. 
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APPENDIX C 


EVOLUTION OF SUITABLE TERRAIN -FOLLOWING DISPLAY 


Figure 1 is a sketch of an aircraft flying in proximity to the terrain. 
It is the attitude and relative position of the aircraft in this sketch that 
is shown in each of the subsequent sketches of the various situational dis- 
plays used. The displays were evolutionary; that is, each successive display 
was identical to its predecessor except for the modifications discussed below 


Display A 


The elements of the first display (fig. 2(a)) were established as 
follows. Because the primary reference in aircraft control is the horizon, a 
horizon bar was deemed a requirement of the display. The zero reference and 
scaling used were similar to those of a standard aircraft gyro horizon instru- 
ment . Also, because the distance to the terrain below is important in this 
task, this information was represented by a horizontal line displaced downward 
from the center of the display to indicate height directly above the terrain. 
The scaling set at 333 ft/cm permitted 1500-foot variations in height. In 
addition, it was assumed that predictive information required for successful 
terrain -following could be provided by using a vertical scanning pencil radar 
to determine inclination from the horizontal to points on the terrain at fixed 
ranges ahead. It was arbitrarily decided to use two such points spaced ahead 
at ranges equivalent to a 5- and a 10-second elapsed flight time . These 
time periods were not varied throughout this investigation. The scaling on 
these inclination angles was the same as the pitch angle, namely, 15 ° = 1 cm, 
and the zero reference used was the CRT center . 

Terrain -following attempts with this display were "catastrophic." The 
display lacked coherence between the terrain depicted and the horizon 
depicted; the pilot was required to read two different types of presentation 
superimposed upon each other in an unfamiliar fashion. 

The horizon bar as displayed had the usual "inside out" orientation and 
its motion was comparable to the apparent motion of the horizon as viewed 
through the windshield. The terrain heights displayed had only a partial 
"inside out" orientation; that is, as the aircraft climbed up from the 
terrain, the terrain height indicators moved in the downward direction simi- 
lar to the apparent downward motion of terrain perceived through the wind- 
shield of a climbing aircraft. However, as the aircraft was varied in pitch 
attitude only, no motion was evident on the terrain height indicators which 
conflicted with a complete "inside out" presentation of the terrain. It was 
this discrepancy which caused the display to give the impression of being 
two superimposed instruments, requiring divided attention, rather than the 
desired single instrument giving a unified "view" of the outside world. 
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Display B 


The second display attempt (fig. 2(b)) differed from the first only in 
the zero reference of the terrain ahead and below. In display B the center 
of the horizon bar was used as the zero point to give a complete "inside out" 
presentation. Thus, if a hilltop at the same elevation as the aircraft were 
ahead and the aircraft were held in level flight, each terrain indicator 
would rise to the center of the horizon bar and then fall in succession as 
the simulated aircraft passed over the hilltop. 

Tracking efforts with this display were also -unsuccessful, though a 
definite improvement was noted. The display, with the exception of the 
terrain -below indicator, gave a scaled down picture of the "real world" 
directly ahead as it would appear through the windshield. The scaling of 
displayed angles to real angles as would be seen through the windshield was 
1 to 13 as determined from the subject's ocular distance from the display 
(19 in.) and the display scaling. 


Display G 


To increase the magnification of angles to distant (lO sec) hills the 
scaling was increased so that terrain and pitch angles were 6°/cm on the CRT, 
figure 2(c). Though the subject's performance improved somewhat, it was still 
inadequate as shown by figure 13 which is a pen record of performance with 
this display. Small angles perceived in the 10 -second -ahead indicator loomed 
up too quickly in the 5-second-ahead indicator for adequate terrain-following 
and collisions with hilltops were frequent . Apparently the predictive infor- 
mation available was being attenuated to the extent that the subject was 
unable to respond soon enough to the requirement for a hard pull-up. 


Display D 


To give more magnification to the terrain ahead and to place the terrain- 
ahead elements and the height-below element together in a compatible dimen- 
sion, the perspective effect was removed and the angles to the terrain ahead 
were transformed to approximate differences in altitude between the aircraft 
and the points ahead (fig. 2(d)). The scaling on the terrain ahead indicators 
was set at 333 ft/cm to agree with the scaling of the terrain directly beneath 
indicator. The resulting display gave an "inside out" orthographic portrayal 
of the outside world. 

Apparently this display provided a strong prediction or lead cue, for 
the subject no longer flew into (or very near to) the fronts of the hills; 
instead, he tended to overcompensate and often acquired too much altitude 
before each hill. In general, his performance over the hilltops was erratic. 
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The subject’s impression was that even though the display gave sufficient 
warning of the magnitude of approaching hills, there remained an indefinite - 
ness as to the altitude differential between the aircraft and the peak ahead. 
This was most evident when the approaching peak was between the points where 
terrain heights were computed and at the same time the aircraft altitude was 
changing . 

To allow the subject to fix the altitude of the peaks, a relative (to 
sea level) altimeter was added along side of the display. Thus, when the 
pilot saw a peak ahead of the aircraft in the 10-second -ahead display element, 
he esti ma ted its height above the aircraft directly from the display and 
mentally added it to- the altimeter reading to determine the relative altitude 
of that peak. Then the subject "climbed" above that altitude and felt secure 
that he would not contact the ground. 

With this relatively crude technique of using display D and an altimeter, 
a 90 -minute terrain -following run was made with no ground contacts. 


Display E 


In display E (fig. 2(e)) the need for the altimeter was eliminated 
because an additional element was introduced which represented the maximum 
altitude of the terrain 10 seconds ahead less the current altitude of the 
aircraft. This element, a single dot on the CRT y-axis, was allowed to 
coincide with the terrain 10 -second -ahead bar as long as the terrain ahead 
was level or sloping upward. Should the indicator for the 10 -second -ahead 
terrain begin to fall, indicating that a peak was approaching, the "memory" 
dot was left as an indication of the height of this peak relative to the 
altitude of the aircraft. At this time the pilot had 10 seconds to bring 
this dot to some distance below the horizon line so as to clear the peak 
ahead by a desired height. A button switch was also provided, which when 
activated by the subject, drove the "memory” dot back down to coincide with 
the 10 -second -ahead terrain bar. A sample of terrain -following with this 
display is presented in figure 1^. 


Display F 


Though display E appeared to provide all the required elements for 
reasonable tracking of the generated terrain, It was believed that a greater 
resolution of both pitch angle and terrain ' he ight would allow terrain- 
following with less ground clearance. Subsequently, the scaling on all 
height information was changed to 250 ft/cm (from 333 ft/cm) and the scaling 
on the pitch angle was changed to 2.2°/cm (from 6°/cm). This fairly high 
magnification for pitch angle was selected for several reasons. First, it 
appeared that level-flight -altitude control improved as the magnification of 
the pitch angle was increased. Within certain limits (not explored in this 
study) this effect was understandable, inasmuch as a fairly high resolution 
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of pitch angle became a prerequisite for good altitude control at the 
simulated velocity, especially since rate of climb information was not avail- 
able to the pilot. Second, a limit on magnification of pitch angle was 
approximately established by terrain slope (i.e., some of the terrain slopes 
generated were as high as 3 OO ft/sec) or an inclination of 13°. Since the 
foregoing considerations placed the scaling of pitch angle at approximately 
2°/cm, it was decided to take advantage of the fact that, for the 5 -second- 
ahead terrain indicator, height and angle coincided if pitch scaling was 
2.2°/cm; that is, a point 1-1/4- miles ahead of the aircraft and 250 feet 
below the altitude of the aircraft would also be 2.2° below the horizon. 

This allowed a simultaneous presentation of the relative angle and the rela- 
tive height to the terrain 5 seconds ahead. Thus, if the relatively small 
deviations in angle of attack that would occur at this flight mode were 
ignored, the pilot need only point the nose of the aircraft (indicated by the 
miniature airplane fixed in the CRT center) to a desired height above a 
point on the terrain 5 - seconds-ahead indicator to know that, if he held this 
attitude, he would arrive over that point, in 5 seconds, at the preselected 
height. The scaling effect of display F is illustrated in figure 2(f). 

Terrain -following performance with display F was not directly comparable 
with performance for any of the preceding displays since at this time the 
terrain generator was modified to better represent actual terrain (California 
hills, see appendix B) . Because the terrain -following task was made easier 
by the terrain modification, the subsequent improvement in performance cannot 
be solely attributed to changes made to the display. A sample of terrain- 
following under these conditions is presented in figure 15 . 
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APPENDIX D 


METHOD USED TO EVALUATE TERRAIN -FOLLOWING PERFORMANCE 


In order to assess the effects of changes in the visual display, of 
fatigue, etc., a relationship between the task and performance was defined 
so that, when sample data were analyzed, improvement or degradation of per- 
formance could be detected. Since the requirement was not to describe per- 
formance but only to rate performance, it was believed that the simple linear 
relationship of equation (l) would be adequate. 

A(t) = aT(t) + b + e(t) (l) 


where 

A(t) aircraft altitude at time t 

a slope parameter 

T(t) terrain altitide at time t 

b translation parameter 

e(t) error in linear fit at time t 

It was assumed that performance was best when the aircraft was following 
the terrain contour exactly at a constant height . Though this may appear 
unrealistic, and possibly undesirable where high-frequency terrain is encoun- 
tered, it was believed that performance improved when it tended toward this 
ultimate and vice versa. 

To evaluate the parameters in equation (l), it was decided to use data 
at independent sample points; consequently, equation (l) becomes 

Ap = aT 2 _+b+ep ( 2 ) 

where the subscript denotes the ith sample . 

To obtain independent samples, it was reasoned that the time interval 
for sampling need only be as great as that at which no autocorrelation was 
evident in the terrain since it was unlikely that the aircraft flight path 
would exhibit any autocorrelation beyond this interval. The method of 
determining this time interval was explained in appendix B. 

The method of least squares was used to find values of a and b for 
N 

which Z e^ 2 is a minimum; these are: 
i=i 
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CTlAT - ZA2T 

N2T - (nr ) 2 


( 3 ) 


SA. - aUC 
N 




where the sums are over -all sample points. 

Formulas (3) and (4) can he rewritten in the more familiar statistical 
notation (keeping in mind that no distribution functions have been assumed) : 


a 



(5) 


b = A - T 




( 6 ) 


where A and T are sample means, and Sj, are sample standard deviations, 
and r is the sample correlation coefficient. The elements of formula ( 5 ) 
were used as follows in evaluating terrain-following performance. The corre- 
lation coefficient, r, in the ultimate case would be 1.00 and any lower 
value, that is, 1 > r >0, would indicate a lack of phasing with the terrain 
or motion not associated with the terrain. The ratio, S^/Srp, can be inter- 
preted as representing the over-all amplitude ratio of aircraft motion to 
terrain motion and in the ultimate case would also be 1.00. A value greater 
than 1.00 would suggest that the pilot was either overcontrolling (i.e., 
flying high over the hilltops and low in the valleys) or was generally devi- 
ating about the desired flight path (the latter case would be excluded if the 
correlation coefficient were 1.00). If this ratio were less than 1.00, the 
inference could be made that the pilot was smoothing, or not responding to 
the terrain . For the purpose of this study, performance was considered to 
have improved when the values of r and S^/Sp moved closer to 1.00, and to 
have degraded when r moved toward zero and Sa/Sp deviated from 1.00 in 
either direction . 


Though the parameter b as determined in formula (6) is most useful in 
describing the flight path of the aircraft with respect to the terrain (i.e., 
eq. (l) fits the flight path to given terrain), it was decided to use the more 
familiar H, mean height above_the_terrain, in assessing performance . Note 
that the substitution of A = H + T in formula (6) gives: 


b 


= H + T 1 



-* A 





as 




( 7 ) 
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which is another way of saying that H is meaningful only if the aircraft 
flight path is approximating the terrain. 

The standard deviation of aircraft height above the terrain, Sg, was 
also included in the tables of this report since it was anticipated that many 
readers would want this information; however, in doing so, it is pointed out 
that Sg is not independent of the other statistics already discussed. 


S H 2 = S A 2 + S T 2 - 2x3^ 


(8) 


The appropriateness of assuming a linear relationship between aircraft 
flight path and terrain can be determined as follows. Equation ( 2 ) and for- 
mulas (5) and. (6) give the following expressions for the mean and standard 
deviation of the error term in equation ( 2 ) . 


N 



i=i 


N 



i=i 



A + T 



s 


e 


N 



i=i 


N 



i=i 


A) 


°A 

Sp 





(9) 


= S A n/i - r 2 


( 10 ) 


Formula ( 9 ) assures that the mean error in the fitted linear expression 
will always be zero. Formula (10), the standard deviation (or RMS since 
e =0) of this error term, shows the dependence of the validity of a linear 
assumption on the value of the correlation coefficient. 
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Figure 1.- Profile of flight path and terrain during terrain -f ollowing . (Attitude and posit 

of aircraft depicted by each display in figure 2.) 
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(a) Display A; angles to terrain (b) Display B; same as A except zero 

ahead scaled 15°/cm^ terrain below reference of terrain translated to 
333 ft/cm; scope center is zero horizon center, 

reference . 




(c) Display C; pitch and terrain (d) Display D; terrain ahead shown 

angles rescaled to 6°/cm. as relative heights; 333 ft/cm. 



(e) Display E; height memory dot (f) Display F; heights rescaled to 

(maxima of terrain 10 sec ahead) 250 ft/cm; pitch angle = 2.2°/cm. 

added . 


Figure 2 .- Variations in situational displays. 
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Figure 4.- Block diagram of experimental configuration. 
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Figure 5.- Histogram of height above terrain; simulated terrain-following using display C 
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Figure 6.- Histogram of height above terrain; simulated terrain -following using display D and 

an altimeter. 
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Figure 7 • - Histogram of height above terrain; simulated terrain -following using display E. 
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90 sample points at a 10-second sampling rate 
(Effectively 30 independent samples) 



0 100 200 300 400 500 600 700 

Height above terrain, ft 


Figure 8.- Histogram of height above terrain; simulated terrain -following using display F. 
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Figure 9.- Histogram of height above terrain; visual terrain -following over hilly African 

desert with maxim um effort in a Hunter 6 at a Mach number of 0.7* (Data were extracted from 
ref. 3, fig. 3(c) .) 
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(b) Sample profile of the reduced -frequency simulated terrain of this study (Mach number 1.2). 

Figure 10.- Comparison of terrain for two studies. 
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(a) Histogram of 200-data points at a 10-second sampling rate. 
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(b) Sample profile of the simulated terrain. 

Figure 11.- High-frequency terrain generation. 
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Figure 12.- Comparison of the high-frequency and low -frequency simulated terrain of this study 
with a sample of hilly California terrain (Oakland to Avenal via V-107) • 






Altitude t ft 


3000 - 
2000 - 
1000 - 

L 

0 

Figure 



13.- Sample of performance in simulated terrain-following using display C. 
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Figure l4.- Sample of performance in simulated terrain-following using display E. 
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Figure 15.- Sample pen record of performance in simulated terrain-following using display F and 

reduced -frequency terrain . 
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